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A UNIFIED METRIC FOR DIGITAL VIDEO PROCESSING (UMDVP) 



5 The system and method of the present invention is directed to a unified metric for 

controlling digital video post-processing where the metric reflects local picture quality of 
an MPEG encoded video. More particularly, the system and method of the invention 
provides a metric that can be used to direct a post-processing system in how much to 
enhance a pixel or how much to reduce the artifact, thereby achieving optimum quality of 
10 the final post-processed result. 

Compressed digital video sources have come into modem households through 
digital terrestrial broadcast, digital cable/satellite, PVR (Personal Video Recorder), DVD, 
etc. The emerging digital video products are bringing revolutionary experiences to 

15 consumers. At the same time, they are also creating new challenges for video processing 
functions. For example, low bit rates are often chosen to achieve bandwidth efficiency. 
The lower the bit rates, the more objectionable become the impairments introduced by the 
compression encoding and decoding processing. 

For digital terrestrial television broadcasting of standard-definition video, a bit rate 

20 of around 6 Mbit/s is considered a good compromise between picture quality and 
transmission bandwidth efficiency, see P.N. Tudor, "MPEG-2 Video Compressions," IEEE 
Electronics & Communication Engineering Journal, December 1995, pp. 257-264. 
However, broadcasters sometimes choose bit rates far lower than 6 Mbit/s to have more 
programs per multiplex. Meanwhile, many processing functions fail to take the digital 

2 5 compression into account. As a result, they may perform sub-optimally on the compressed 
digital video. 

MPEG-2 has been widely adopted as a digital video compression standard, and is 
the basis of new digital television services. Metrics for directing individual MPEG-2 post- 
processing techniques have been developed. For example, in Y. Yang and L. Boroczky, 
30 "A New Enhancement Method for Digital Video Applications", IEEE Transactions on 
Consumer Electronics, Vol. 48, No. 3, August 2002, pp. 435-443 , the entire contents of 
which ate hereby incorporated by reference as if fully set forth herein, the inventors define 
a usefulness metric (UME: Usefulness Metric for Enhancement) for improving the 
performance of sharpness enhancement algorithms for post-processing of decoded 
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compressed digital video. However, a complete digital video post-processing system must 
include not only sharpness enhancement but also resolution enhancement and artifact 
reduction. UME's and other metrics 9 focus on sharpness enhancement alone limits their 
usefulness. 

5 Picture quality is one of the most important aspects for digital video products (e.g., 

DTV, DVD, DVD record, etc.). These products receive and/or store video resources in 
MPEG-2 format The MPEG-2 compression standard employs a block-based DCT 
transform and is a lossy compression that can result in coding artifacts that reduce picture 
quality. The most common and visible of these coding artifacts are blockiness and ringing. 

10 Among the video post-processing functions performed in these products, sharpness 
enhancement and MPEG-2 artifact reduction are the two key functions for quality 
improvement It is extremely important for these two functions not to cancel out each 
other's effects. For instance, MPEG-2 blocking artifact reduction tends to blur the picture 
while sharpness enhancement makes the picture sharper. If the interaction between these 

15 two functions is ignored, the end result may be to restore the blocking effect by the 
sharpness enhancement even though the early blocking artifact reduction operation reduced 
the block effect. 

Blockiness manifests itself as visible discontinuities at block boundaries due to the 
independent coding of adjacent blocks. Ringing is most evident along high contrast edges 

20 in areas of generally smooth texture and appears as ripples extending outwards from the 
edge. Ringing is caused by abrupt truncation of high frequency DCT components, which 
play significant roles in the representation of an edge. 

No current metric is designed to direct the joint application of enhancement and 
artifact reduction algorithms dining post-processing. 

25 Thus, there is a need for a metric which can be used to direct post-processing that 

effectively combines quality improvement functions so that total quality is increased and 
negative interactions are reduced. The system and method of the present invention 
provides a metric for directing the integration and optimization of a plurality of post- 
processing functions, such as, sharpness enhancement, resolution enhancement and artifact 

30 reduction. This metric is A Unified Metric for Digital Video Processing (UMDVP) that 
can be used to jointly control a plurality of post-processing techniques. 

UMDVP is designed as a metric based on the MPEG-2 coding information. 
UMDVP quantifies how much a pixel can be enhanced without boosting coding artifacts. 
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In addition, UMDVP provides information about where artifact reduction functions should 
be carried out and how much reduction needs to be done. By way of example and not 
limitation, in a preferred embodiment, two coding parameters are used as a basis for 
UMDVP: the quantisation parameter (q_scale) and the number of bits spent to code a 
5 luminance block (niimjbits). More specifically, num_bits is defined as the number of bits 
spent to code the AC coefficients of the DCT block. q_scale is the quantization for each 
16x16 macroblock and can be easily extracted from every bitstream. Furthermore, while 
decoding a bitstream, num_bfts can be calculated for each 8x8 block with little 
computational cost. Thus, the overall overhead cost of collecting the coding information is 
10 negligible. 

FIG. la illustrates a snapshot from a "Calendar" video sequence encoded at 
4Mbits/s. 

FIG. lb illustrates an enlargement of an area of FIG. la that exhibits ringing 
artifacts. 

15 FIG. 2a illustrates a snapshot from a "Table-tennis" sequence encoded at 1.5 

Mbits/s. 

FIG. 2b illustrates an enlargement of an area of FIG. 2a that exhibits blocking 
artifacts. 

FIG. 3a illustrates a horizontal edge, according to an embodiment of the present 
2 0 invention. 

FIG. 3b illustrates a vertical edge, according to an embodiment of the present 
invention. 

FIGs. 3c and 3d illustrate diagonal edges for 45 and 135 degrees, according to an 
embodiment of the present invention. 

2 5 FIG. 4 illustrates a flow chart of an exemplary edge detection algorithm, according 

to an embodiment of the present invention. 

FIG. 5 is a system diagram of an exemplary apparatus for calculation of the 
UMDVP metric, according to an embodiment of the present invention. 

FIG. 6 illustrates a flowchart of an exemplary calculation of the UMDVP metric for 

3 0 I-frames, according to an embodiment of the present invention. 

FIG. 7 illustrates an exemplary interpolation scheme for use in calculating the 
UMDVP metric, according to an embodiment of the present invention. 
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FIG. 8 illustrates an exemplary flow chart of an algorithm for calculation of the 
UMDVP metric for P or B frames, according to an embodiment of the present invention. 
FIG. 9 illustrates a vertical interpolation scaling scheme of the present invention. 
FIG. 10 illustrates a horizontal interpolation scaling schema of the present 
5 invention. 

FIG. 11 illustrates a system diagram for an exemplary sharpness enhancement 
apparatus, according to an embodiment of the present invention. 

FIG. 12 illustrates the fundamental structure of a convention peaking algorithm. 
FIG. 13 illustrates applying the UMDVP metric to peaking algorithms to control 
1 0 how much enhancement is added to the original signal. 

FIG. 14 illustrates a specific peaking algorithm. 

FIG. 15 illustrates using the UMDVP metric to prevent the enhancement of coding 
artifacts in the apparatus illustrated in FIG. 14. 

The relationship between picture quality of compressed digital video sources and 
15 coding information is well known, i.e., picture quality of a compressed digital video is 
directly affected by how it has been encoded. The UMDVP metric of the present invention 
is based on the MPEG-2 coding information and quantifies how much a pixel can be 
enhanced without boosting coding artifacts. In addition, it can also point out where artifact 
reduction functions should be carried out and how much reduction needs to be done. 
2 0 . 1 . Unified Metric for Digital Video Processing (UMDVP) 

UMDVP uses the coding information such as the quantisation parameter (qjscale) 
and the number of bits spent to code a luminance block (num_bits). q_scale is the 
quantisation scale for each 16x16 macroblock. Both are easily extracted from every 
bitstream. 

25 1.1 Quantisation scale (q_scale) 

MPEG schemes (MPEG-1, MPEG-2 and MPEG-4) use quantisation of the DCT 
coefficients as one of the compression steps. But, quantisation inevitably introduces errors. 
The representation of every 8x8 block can be considered as a carefully balanced aggregate 
of each of the DCT basis images. Therefore a high quantisation error may result in errors 

30 in the contribution made by the high-frequency DCT basis images. Since the high- 
frequency basis images play a significant role in the representation of an edge, the 
reconstruction of the block will include higji-frequency irregularities such as ringing 
artifects. Fig. la illustrates a snapshot from a "Calendar" video sequence encoded at 4 
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Mbit/s. The circled part 10 of FIG. la is shown enlarged 11 in FIG. lb, in which ringing 
artifacts 12 can be seen around the edges of the digits. 

The larger the value of q_scale the higher is the quantisation error. Therefore, 
UMDVP is designed to increase as q_scale decreases. 
5 1.2 The number of bits to code a block (num_bits) 

MPEG-2 uses a block-based coding technique with a block-size of 8 by 8. 
Generally, the fewer bits used to encode a block the more information of the block that is 
lost and the lower the quality of the reconstructed block. However, this quantity is also 
highly dependent on scene content, bit rate, frame type (such as I, P and B frames), motion 
10 estimation, and motion compensation. 

For a non-smooth area, if numjtits becomes 0 for an intra-block, it implies that 
only the DC coefficient remains while all AC coefficients are absent. After decoding, 
blocking effects may exist around this region. Fig. 2a is a snapshot from a "Table-tennis" 
sequence encoded at 1 .5 Mbit/s. The blocking effect is very clear in the circled area 20 of 
1 5 FIG. 2a that is shown enlarged 2 1 in FIG. 2b. 

The smaller num_bits, the more likely coding artifacts exist. As a result, the 
UMDVP value is designed to decrease as nunrbits decreases. 
1 .3 Local Spatial Feature 

Picture quality in an MPEG-based system is dependent on both the available bit 
2 0 rate and the content of the program being shown. The two coding parameters: q__scale and 
num_bits only reveal information about the bit rate. The present invention defines another 
quantity to reflect the picture content. In the present invention, a local spatial feature 
quantity is defined as an edge-dependent local variance used in the definition of UMDVP. 
1.3.1 Edge Detection 

25 Before calculating this local variance at pixel (ij), it must be determined if the 

pixel(ij) belongs to an edge. If it does, the edge direction is determined. The present 
invention only considers three kinds of edges, as shown in FIG. 3a for horizontal edges, 
FIG. 3b for vertical edges and FIGs. 3c and 3d for diagonal edges ( 45 or 135 degrees). 
FIG. 4 illustrates a flowchart of an exemplary edge detection algorithm. At step 41 and 

30 step 43, two variables (h_abs and v_abs) are calculated based on h_out and vjrat, which 
are calculated in steps 40 and 42, respectively. Then these two variables are measured 
against the corresponding thresholds: HTHRED and VTHRED at step 44. If h_abs and 
vjibs are larger than HTHRED and VTHRED respectively, it is determined at step 47 that 
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pixel (i j) belongs to a diagonal edge. Otherwise if h_abs is larger than HTHRED but 
vjabs is smaller than or equal to VTHRED, it is determined at step 46 that pixel (i j) 
belongs to a vertical edge. If v_abs is larger than VTHRED but hjabs is smaller than or 
equal to HTHRED, it is determined at step 49 that pixel (i j) belongs to a horizontal edge. 
5 Finally if h_abs and vabs are smaller than or equal to HTHRED and VTHRED 
respectively, it is determined at step 50 that pixel (i j) does not belong to an edge. By way 
of example and not limitation, in a preferred embodiment, the two thresholds, V-THRED 
and HJTHRED, are set to 10. Furthermore, to make the edge detection more robust an 
extra step is applied to eliminate the isolated edge points: 
10 1 . If pixel(i j) is identified as a horizontal edge pixel and if neither pixel(i-l j) 

nor pixel(i+lj) belong to a horizontal edge then pixel(ij) will be 

disqualified as an edge pixel; 

2. If pixel(ij) is identified as a vertical edge pixel and if neither pixel(i j-1) nor 
pixel(i j+1) belongs to a vertical edge then pixel(ij) will be disqualified as 

15 an edge pixel; and 

3. If pixel(i j) is identified as a diagonal pixel and if none of pixel(i-l j-1), 
pixel(i-l j+1), pixel(i+l j-1), and pixel(i+l j+1) belong to a horizontal edge, 
pixel(i j) will be disqualified as an edge pixel. 

1 .3 .2 Edge-Dependent Local Variance 
2 0 When pixel (i j) belongs to a horizontal edge, the edge-dependent local variance is 

defined as: 

j) = \pixel(i 9 mean\ + \pixel(i 9 j) - mear\ + \pixel(i, j + mean\ 

(1) 



where mean = 



^pixeliij + g) 
Iff— 1 . 



3 

25 (2) 

When pixel (i j) belongs to a vertical edge, the edge-dependent local variance is defined as: 
var(i, j) = \pixel(i - - mean\ + \pixel{i,j) - mean] + \pixel(i + 1, j) - mean] 

(3) 
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3 

(4) 

When pixel(i j) belongs to a diagonal edge, the edge-dependent local variance is defined 
as: 

var(i 9 j) = \pixel(i - 1, j - 1) - meaw| + |/wce/(/, 7) - mean| + \pixel(i - 1, 7 + 1) - mean\ 
+ |/>fre/(f + 1, 7 - 1) - /neaw| + + 1, 7 + 1) - mear\ 

(5) 

where mean = 

(j)ixel(i-lj + pixel(i + + pixel(ij) + pixelji + 1,7 -l) + pfre/(i + l,7 + 1)) 

5 - 

(6) 

1 0 When pixel(i j) does not belong to any of the aforementioned edges, the variance is defined 
as: 

11 

var(ij) = Yi 2l^ fee, C + p9j + $ mea H 
(7) 

I 1 



where meaw = 



9 

15 (8) 

The edge-dependent local variance reflects the local scene content of the picture. This 
spatial feature is used in the present invention to adjust and refine the UMDVP metric. 
1.4 Definition of UMDVP 

By way of example and not limitation, UMDVP can be defined based on 
2 0 observations of the two coding parameters (num_bits and q_scale), as the following 
function: 

num bits 



UMDyp = JL= sc^e 



-Q OFFSET 



Q_OFFSET 
(9) 
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where Q_OFFSET is an experimentally determined value. By way of example and not 
limitation, Q_OFFSET can be determined by analyzing the bitstream while taking quality 
objectives into account. A value of 3 is used for QJDFFSET in a preferred embodiment 
of the present invention. The UMDVP value is limited to the range of [-1,1]. If numjbits 
5 equals to 0, UMDVP is set to 0. Taking the local spatial feature into account, the UMDVP 
value is further adjusted as follows: 



10 



UMDVP = UMDVP + 1 if {{UMDVP < 0) & (yar > VAR THRED)) 
(10) 

where VARJTHRED is a pre-detennined threshold that is empirically determined. By 
way of example and not limitation, VARJTHRED can be determined by analyzing the bit 
stream while taking quality objectives into consideration. 

The value of UMDVP is further refined by the edge-dependent local variance: 

15 UMDVP{iJ) = UMDVP(iJ) * f YSlM. \ (1 1) 



VARJTHRED J 



Here again, the UMDVP value is limited to the range between -1 and 1, inclusive. A value 
of 1 for UMDVP means that sharpness enhancement is absolutely allowed for a particular 
pixel, while if the value is -1, the pixel can not be enhanced and artifact reduction 

2 0 operations are needed. 

2. UMDVP Calculation For MPEG-2 Video 

The UMDVP metric is calculated differently depending on whether the frame is an 
I-frame, P-frame or B-frame. Motion estimation is employed to ensure temporal 
consistency of the UMDVP, which is essential to achieve temporal consistency of 
25 enhancement and artifact reduction. Dramatic scene change detection is also employed to 
further improve the performance of the algorithm. The system diagram of the UMDVP 
calculation for MPEG-2 video is illustrated in FIG. 5. 
2.1 Motion estimation (55) 

By way of example and not limitation, an embodiment of the present invention 

3 0 employs a 3D recursive motion estimation model described in Gerard de Haan et al, 'True- 

Motion Estimation with 3-d Recursive Search Block Matching", IEEE Transactions on 
Circuits and Systems for Video Technology, Vol. 3, No. 5, October 1993, pp368-379, the 
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entire contents of which are hereby incorporated by reference as if fully set forth herein. 
Compared with a block-based full-search technique, this 3D model dramatically reduces 
the computational complexity while improving the consistency of motion vectors. 
2.2 Scene change detection (53) 
5 Scene change detection is an important step in the calculation of the UMDVP 

metric, as a forced temporal consistency between different scenes can result in picture 
quality degradation, especially if dramatic scene change occurs. 

The goal of scene change detection is to detect the content change of consecutive 
frames in a video sequence. Accurate scene change detection can improve the performance 
10 of video processing algorithms. For instance, it is used by video enhancement algorithms 
to adjust parameters for different scene content. Scene change detection is also useful in 
video compression algorithms. 

Scene change detection may be incorporated as a further step in the UMDVP 
calculation, as a forced temporal consistency between different scenes can result in picture 
15 quality degradation, especially if a dramatic scene change occurs. 

Any known scene change detection method can be used. By way of example and 
not limitation, in a preferred embodiment, a histogram of the differences between 
consecutive frames is examined to determine if a majority of the difference values exceed a 
predetermined value. 
2 0 2.3 UMDVP calculation for I, P and B frames (54) & (56) 

FIG. 6 illustrates a flowchart of a preferred embodiment of the calculation of the 
UMDVP metric for I-frames. At the first step 61, an initial UMDVP value is calculated by 
Eq. (9). Then dramatic scene change detection is applied at 62. If a scene change has 
occurred, the calculation ends at 64. Otherwise, motion estimation is used to find the 
2 5 motion vector (v',h') (63) for the current 8x8 block. In FIG. 6, UMDVP jprev(v',h') is the 
value of the UMDVP metric at the location pointed by (v'Jh') in the previous frame. If the 
position pointed at by (v',h*) does not co-site with a pixel, an interpolation is needed to 
obtain the value of the UMDVP metric. 

The interpolation scheme is illustrated in FIG. 7. Suppose it is necessary to 
30 interpolate the UMDVP value at the location indicated by from the values of the 
UMDVP values at the locations indicated by "X". Assuming the value of the UMDVP 
metric at the top-left comer is UMDVP 1 70, the one at the top-right comer is UMDVP2 
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71, the one at the bottom-left corner is UMDVP3 72, and the one at the bottom-right comer 
isUMDVP4 73. 

UMDVP = {l-/3)*{{l-a)xUMDVPl + axUMDVP3) + ^ 
fi x ((1 - a) x UMDVP2 + ax UMDVPA) 

5 At step 65, the value of the UMDVP metric is adjusted based on the calculated value of the 
UMDVP metric at step 61 or the interpolated value of the UMDVP metric and the value of 
the UMDVP metric at the location pointed at by (v' ,h') in the previous frame and, in a 
preferred embodiment, Ri is set to 0.7 to put more weight on the calculated value of the 
UMDVP metric 

10 

UMDVP = i?ix UMDVP + (1 - Ri) x UMDVP _ prev(y\ h % ) 

(13) 

FIG. 8 illustrates a flow chart for a calculation of the value of the UMDVP metric 

15 for P or B frames. First, it is determined at step 81 whether there is a scene change. If so, 
the condition C 3 , {{Intra - block) and {num_bits * 0)) is tested at step 82. If the condition 
is satisfied, the value of the UMDVP metric is calculated at step 83 by Eq. (9). If the 
condition is not satisfied, or no scene change is detected at step 81, motion estimation is 
applied to find the motion vector (v',h') for the current block at step 84. The value of the 

20 UMDVP metric is set to be the one pointed at by (v',h') in the previous frame at step 85. 
Again, the interpolation scheme of Eq. (12) is needed if the position pointed at by (v\h>) is 
not exactly at a pixel location. 

The final block "UMDVP refinement" 58 in FIG.5 uses Eq. (10) and Eq. (1 1) to 
adjust and refine the UMDVP value by the edge-dependent local variance. 

2 5 The UMDVP memory 57 is used to store intermediate results. 

2.4 UMDVP Scaling 

If the video processing algorithm runs not on the original resolution but on some 
higher resolution, scaling functions are needed for the UMDVP map to align with the new 
resolution. Vertical and horizontal scaling functions may be required for UMDVP 

30 alignment 

2.4. 1 Vertical scaling 
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In FIG. 9a, the solid black circle 90 represents the location of the UMDVP value to 
be interpolated. If, at step 94 a > A\ ( Ai is set to 0.5 in a preferred embodiment), which 
means the interpolated location is closer to (ij+1) than to (ij), then UMDVP_new 90 is 
more related to UMDVP(ij+l) 92 than to UMDVP(ij) 91. Therefore, at step 95 
5 UMDVPjaew is set to (1 - 2b) * UMDVP(i,j + 1) • The smaller the value of b, me closer 
the new interpolated UMDVP_new 90 is to UMDVP(ij+l) 92. Otherwise, if at step 94 
a <. Ai, which means the interpolated location is closer to (ij), then UMDVP_new 90 is 
more related to UMDVP(ij) than to UMDVP(ij+l). Therefore, at step 97 UMDVPnew 
is set to (l-2a)*UMDVP(i,j). However, if it is determined at step 93 that bolh 
10 UMDVP(ij) 91 and UMDVP(ij+l) 92 are larger than UT (in a preferred embodiment UT 
is set to 0.3), which means the neighborhood is a homogeneous area with large UMDVP 
values, a bilinear interpolation is used at step 96 to generate UMDVPnew 90 as 
UMDVP_new = a*UMDVP(ij)+b*UMDVP(ij+l). 
2.4.2 Horizontal scaling 
15 in FIG. 10a, the solid black circle 101 represents the location of the UMDVP value 

to be interpolated. If, at step 104 a > Ai{ Ai is set to 0.5 in a preferred embodiment), 
which means the interpolated location is closer to (i+1 j) than to (ij), UMDVP_new 101 is 
more related to UMDVP(i+l j) 102 than to UMDVP(ij) 100. Therefore, at step 105 
UMDVP_new 101 is set to Q.-2b)*UMDVP(i+\,j). The smaller the value of b, the 
20 closer the new interpolated UMDVP_new 101 is to UMDVP(i+l j) 102. Otherwise, if, at 
step 104 a <, Ai, which means the location is closer to (ij), UMDVPjnew 101 is more 
related to UMDVP(ij) 100 than to UMDVP(i+lj) 102. Therefore, at step 107, 
UMDVP_new 101 is set to Q.-2a)*UMDVP(i,j) . However, if both UMDVP(ij) 100 
and UMDVP(i+l j) 102 are larger man UT (in a preferred embodiment UT is set to 0.3), 
25 which means the neighborhood is a homogeneous area with large UMDVP values, at step 
106 a bilinear interpolation is used to generate UMDVP_new = 
a*UMDVP(ij)+b*UMDVP(ij+l). 

3. Sharpness Enhancement Using UMDVP for MPEG-2 Encoded Video 

By way of example and not limitation, sharpness enhancement algorithms attempt 
30 to increase the subjective perception of sharpness for a picture. However, the MPEG-2 
encoding process may introduce coding artifacts. If an algorithm does not take me coding 
information into account, it may boost the coding artifacts. 
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By contrast, by using the UMDVP metric it is possible to instruct an enhancement 
algorithm as to how much to enhance the picture without boosting artifacts. 
3 . 1 System diagram 

FIG. 11 illustrates a system diagram of a sharpness enhancement apparatus for 
5 MPEG-2 video using the UMDVP metric. The MPEG-2 decoder 111 sends out the coding 
information 112, such as q_scale and numjrits, to the UMDVP calculation module 114 
while decoding the video bitstream. The details of the UMDVP calculation module 114 
are illustrated in FIG5. The values of the UMDVP metric are used to instruct the sharpness 
enhancement module 1 16 on how much to enhance the picture. 
10 3.2 Sharpness enhancement 

Sharpness enhancement techniques include peaking and transient improvement 
Peaking is a linear operation that uses, for example, in a preferred embodiment, the well- 
known "Mach Band" effect to improve the sharpness impression. Transient improvement, 
e.g. luminance transient improvement (LTT) is a well-known non-linear approach that 
15 modifies the gradient of the edges to enhance the sharpness. 

3.2.1 Integration of the UMDVP metric and peaking algorithms 

Peaking increases the amplitude of the high-band, and/or middle-band frequency 
using linear filtering methods, usually one or several FIR-filters. FIG. 12 illustrates the 
fundamental structure of a peaking algorithm. The control parameters 121 to 12n may be 
2 0 generated by some control functions, which are not shown. They control the amount of 
peaking at each frequency band. 

A straightforward method of applying the UMDVP metric 130 to peaking algorithms 
is to use the UMDVP metric to control how much enhancement is added to the original 
signal. FIG. 13 shows the structure. In a preferred embodiment, Eq. (14) is employed to 

2 5 adjust the value of the UMDVP metric before applying it to an enhancement algorithm. 

' UMDVP UMDVP £0.3 

UMDVP = < UMDVP + 0.5 0.3 < UMDVP < 0.5 (14) 

1.0 UMDVP > 0.5 

When the value of the UMDVP metric is larger than 0.3, it is increased by 0.5. The 
assumption here is that if the value UMDVP metric is above some threshold (0.3 in this 
case), the picture quality is good enough so that sharpness enhancement should not be 

3 0 oversuppressed. 
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A specific example of sharpness enhancement using the UMDVP metric 
By way of example and not limitation, the approach described in G. de Haan, Video 
Processing for Multimedia Systems, University Press, Eindhoven, The Netherlands, 2000, 
allows peaking at two parts of the signal spectrum, typically taken at a half and at a quarter 
5 of the sampling frequency. FIG. 14 illustrates this method which is described below. 

Let /(3c,n)be the luminance signal at pixel position x = (x,y)in picture n. Using 
the z-transform, we can describe the peaked luminance signal f^(x 9 n) , as: 

F p (Z) = F(Z) + k x {r\z' 1 +2z° -1*V(Z) ^ 
+ * 2 (-hT 2 +2z° -\z 2 )F{Z) 
where ki 141 and k 2 142 are control parameters determining the amount of peaking at the 
1 0 middle and the highest possible frequencies, respectively. 

To prevent noise degradation, a common remedy is to only boost the signal 
components if they exceed a pre-detennined amplitude threshold. This technique is known 
as 'coring' 140 and can be seen as a modification of ki and k 2 in Eq.(15). 

The peaking algorithm described above enhances the subjective perception of 
15 sharpness, but at the same time it can also enhance the coding artifacts. To prevent this 
problem, the UMDVP metric 150 can be used to control the peaking algorithm as shown in 
FIG. 15. 

Both enhancement and artifact reduction functions are required to achieve an 
overall optimum result for compressed digital video. The balance between enhancement 
20 and artifact reduction for digital video is analogous to the balance between enhancement 
and noise reduction for analog video. The optimization of the overall system is not trivial. 
However, UMDVP can be used both for enhancement algorithms and artifact reduction 
functions. 

The methods and systems of the present invention, as described above and shown in 
25 the drawings, provide for a UMDVP metric to jointly control enhancement and artifact 
reduction of a digital coded video signal. It will be apparent to those skilled in the art that 
various modifications and variations can be made in the method and system of the present 
invention without departing from the spirit or scope of the invention. Thus, it is intended 
that the present invention includes modifications and variations that are within the scope of 
30 the appended claims and their equivalents. 



